4c75c3c72a389d5fcecd842abeed70a00b8696f7
base v4
- challenge
- Punctuation prediction from conversational language
- submitter
- Oskar Bujacz
- submitted
- 2023-01-25 09:13:06.862739 UTC
- file basename
- out
dev-0 / 1b6210406a4ab7f9a52a46dd1517d053df14f0fc
| Metric | Score |
|---|---|
| Weighted-F1 | 88.19 |
| Hyphens-F1 | 90.91 |
| Comma-F1 | 87.54 |
| Ellipsis-F1 | 63.01 |
| Fullstop-F1 | 95.17 |
| QMark-F1 | 91.25 |
| Colon-F1 | 100.00 |
| Excl-F1 | 0.00 |
worst items
note: the gold standard is taken from the challenge| # | input | expected output | actual output | test-A Weighted-F1 |
|---|---|---|---|---|
| 1 | audio/cbiz_tc_557.wav 10599a11-3bff-4ab0-836d-f9ed7a7cd8aa Czterdzieści:31920-32370 siedem:32430-32670 | O B-FULLSTOP | O B-COMMA | 0.00 |
| 2 | audio/cbiz_tc_557.wav 10599a11-3bff-4ab0-836d-f9ed7a7cd8aa Wie:119580-119670 pan:119700-119760 co:119790-119880 | O O B-ELLIPSIS | O O B-QMARK | 0.00 |
| 3 | audio/cbiz_tc_557.wav 10599a11-3bff-4ab0-836d-f9ed7a7cd8aa @interia.pl:302610-302610 | B-FULLSTOP | B-FULLSTOPO | 0.00 |
| 4 | audio/cbiz_tc_557.wav af63e562-a918-42cd-a6b7-3f7f7c0111fb Tak:52320-52410 więc:52440-52560 poproszę:52770-53460 | O O B-ELLIPSIS | O O B-FULLSTOP | 0.00 |
| 5 | audio/cbiz_tc_557.wav af63e562-a918-42cd-a6b7-3f7f7c0111fb Mhm:128910-128970 | B-QMARK | B-FULLSTOP | 0.00 |
| 6 | audio/cbiz_tc_557.wav af63e562-a918-42cd-a6b7-3f7f7c0111fb Mhm:202080-202110 | B-QMARK | B-FULLSTOP | 0.00 |
| 7 | audio/cbiz_tc_26.wav 597f8543-06b5-4d46-b85c-cd8f43df2264 No:19560-19590 | B-XCL | B-FULLSTOP | 0.00 |
| 8 | audio/cbiz_tc_26.wav 597f8543-06b5-4d46-b85c-cd8f43df2264 A:52020-52020 właśnie:52110-52290 to:52320-52410 mój:52470-52710 | O O O B-FULLSTOP | B-COMMA B-COMMA O B-ELLIPSIS | 0.00 |
| 9 | audio/cbiz_tc_26.wav 597f8543-06b5-4d46-b85c-cd8f43df2264 O:164400-164400 Boże:164520-164820 | O B-FULLSTOP | O B-XCL | 0.00 |
| 10 | audio/cbiz_tc_26.wav a6c94040-593e-4280-8cbf-fb8fb1360e44 Ta:72960-73020 | B-ELLIPSIS | B-FULLSTOP | 0.00 |
| 11 | audio/cbiz_tc_26.wav a6c94040-593e-4280-8cbf-fb8fb1360e44 Termin:122520-122820 płatności:122970-123660 minął:123810-124290 | O O B-ELLIPSIS | O O B-FULLSTOP | 0.00 |
| 12 | audio/cbiz_tc_26.wav a6c94040-593e-4280-8cbf-fb8fb1360e44 No:203430-203490 | B-ELLIPSIS | B-FULLSTOP | 0.00 |
| 13 | audio/cbiz_tc_41.wav 3896bb9d-e80e-458e-9695-4f7427c1abdf jeden:43110-43290 | B-FULLSTOP | B-ELLIPSIS | 0.00 |
| 14 | audio/cbiz_tc_41.wav 1f0220c3-4246-4648-bbe4-53fcc8fe5318 ale:171750-171870 | B-ELLIPSIS | O | 0.00 |
| 15 | audio/cbiz_tc_41.wav 1f0220c3-4246-4648-bbe4-53fcc8fe5318 ta:273000-273060 która:273120-273330 jest:273390-273510 uregulowania:273630-274410… | O O O B-FULLSTOP | B-COMMA O O B-ELLIPSIS | 0.00 |
| 16 | audio/cbiz_tc_24.wav c431c029-b346-4475-a95a-41139fdfac47 od:141270-141330 tej:141450-141510 decyzji:141570-141900 na:141990-142020 adres:14… | O O O O O B-ELLIPSIS | O O O O O B-FULLSTOP | 0.00 |
| 17 | audio/cbiz_tc_56.wav 1b68cc28-468b-45e7-8d07-41101491b69e Domagala:151440-151440 | B-COMMA | B-FULLSTOP | 0.00 |
| 18 | audio/cbiz_tc_56.wav 1b68cc28-468b-45e7-8d07-41101491b69e tak:151530-151680 | B-FULLSTOP | B-QMARK | 0.00 |
| 19 | audio/cbiz_tc_56.wav 1b68cc28-468b-45e7-8d07-41101491b69e Ha:154800-154800 | B-QMARK | B-FULLSTOP | 0.00 |
| 20 | audio/cbiz_tc_56.wav 1b68cc28-468b-45e7-8d07-41101491b69e Tak:154830-154950 | B-ELLIPSIS | B-FULLSTOP | 0.00 |
| 21 | audio/cbiz_tc_56.wav b1ac6642-6e1d-4b46-83b2-710dc8ad743e Czyli:90480-90600 muszę:100500-100800 jakby:100890-101190 zalogować:101250-101550 … | O O O O O B-QMARK | O O O O O B-FULLSTOP | 0.00 |
| 22 | audio/cbiz_tc_56.wav b1ac6642-6e1d-4b46-83b2-710dc8ad743e jakiegokolwiek:132690-134940 innego:134970-135900 | O B-QMARK | O B-FULLSTOP | 0.00 |
| 23 | audio/cbiz_tc_56.wav b1ac6642-6e1d-4b46-83b2-710dc8ad743e Mm:179940-179940 | B-ELLIPSIS | B-FULLSTOP | 0.00 |
| 24 | audio/cbiz_tc_64.wav ed4ff12e-a462-4c82-a004-38ab9fe618bf ta:51720-51780 informacja:51810-52110 | O B-FULLSTOP | O O | 0.00 |
| 25 | audio/cbiz_tc_64.wav 9e40dee7-153b-421b-ae6e-f5504115b826 Hasło:77430-77850 | B-QMARK | B-FULLSTOP | 0.00 |
| 26 | audio/cbiz_tc_64.wav 9e40dee7-153b-421b-ae6e-f5504115b826 To:123480-123660 znaczy:123930-124260 | O B-ELLIPSIS | O B-QMARK | 0.00 |
| 27 | audio/cbiz_tc_26.wav 597f8543-06b5-4d46-b85c-cd8f43df2264 Tak:62490-62880 No:62970-63000 ja:63150-63180 systematycznie:63270-63870 spłacam:6… | B-XCL O O O O O O B-COMMA O O O O O O O O O B-ELLIPSIS | B-FULLSTOP O O O O O O B-COMMA B-COMMA O O O O O O O O O | 22.22 |
| 28 | audio/cbiz_tc_64.wav ed4ff12e-a462-4c82-a004-38ab9fe618bf I:49470-49470 też:49500-49560 od:49590-49620 razu:49680-49950 jak:49980-50040 będę… | O O O O O O O O O B-COMMA O O O O B-ELLIPSIS | O O O B-COMMA O O O O O B-COMMA O B-COMMA O O B-FULLSTOP | 25.00 |
| 29 | audio/cbiz_tc_26.wav 597f8543-06b5-4d46-b85c-cd8f43df2264 sześć:37500-37680 trzy:37890-37950 | B-COMMA B-FULLSTOP | B-COMMA B-COMMA | 33.33 |
| 30 | audio/cbiz_tc_26.wav 597f8543-06b5-4d46-b85c-cd8f43df2264 O:91380-91380 matko:91470-91740 To:91800-91830 ja:91890-91920 nie:91980-92010 mam:… | O B-XCL O O O O O O O B-FULLSTOP | B-COMMA B-FULLSTOP O O O O O O O B-FULLSTOP | 33.33 |
| 31 | audio/cbiz_tc_26.wav 597f8543-06b5-4d46-b85c-cd8f43df2264 Czyli:174750-174870 dostanę:174900-175290 ją:175410-175590 Zaraz:175680-175860 pan… | O O B-ELLIPSIS O O B-FULLSTOP | O O B-FULLSTOP O O B-FULLSTOP | 33.33 |
| 32 | audio/cbiz_tc_26.wav 597f8543-06b5-4d46-b85c-cd8f43df2264 w:219930-219930 tej:219990-220080 ciemności:220110-220620 dopóki:220680-220950 nie… | O O B-COMMA O O B-QMARK O O B-XCL | O O B-COMMA O O B-FULLSTOP O O B-FULLSTOP | 33.33 |
| 33 | audio/cbiz_tc_64.wav 9e40dee7-153b-421b-ae6e-f5504115b826 No:183750-183810 nie:183900-184140 no:184230-184260 w:184320-184320 takim:184380-1… | B-COMMA O B-COMMA O O O O O B-FULLSTOP | O B-COMMA O O O O O O B-FULLSTOP | 33.33 |
| 34 | audio/cbiz_tc_58.wav 4b769478-c84d-4e6a-8d75-804c798b174b Zaraz:26580-26850 zobacz:26970-27150 Prosiłabym:27270-27750 najpierw:27870-28110 o… | O B-ELLIPSIS O O O O O B-FULLSTOP | B-COMMA B-FULLSTOP O O O O O B-FULLSTOP | 33.33 |
| 35 | audio/cbiz_tc_26.wav 597f8543-06b5-4d46-b85c-cd8f43df2264 Muszę:197700-197850 tylko:197910-198120 mam:198210-198300 tylko:198360-198510 możl… | O B-ELLIPSIS O O B-ELLIPSIS O B-COMMA O B-COMMA O B-COMMA O O O O O B-QMARK | B-COMMA O O O B-FULLSTOP O B-COMMA O B-COMMA O B-COMMA O O O O O B-FULLSTOP | 42.86 |
| 36 | audio/cbiz_tc_58.wav 4b769478-c84d-4e6a-8d75-804c798b174b No:87810-87900 domyślam:87930-88200 się:88230-88290 Są:88320-88410 jakieś:88440-88… | B-COMMA O B-ELLIPSIS O O O O O B-COMMA O O O O B-COMMA O O O O O O O O O O B-FULLSTOP | O O B-FULLSTOP O O O O O B-COMMA O O O O O O O O O O O O O O O B-FULLSTOP | 43.33 |
| 37 | audio/cbiz_tc_26.wav 597f8543-06b5-4d46-b85c-cd8f43df2264 I:203310-203310 po:203520-203550 prostu:203610-203790 wpłacić:203910-204270 to:204… | O O O O O B-ELLIPSIS O O O B-COMMA O B-COMMA O B-COMMA B-QMARK | O O O B-COMMA O B-FULLSTOP O O O O O O O B-COMMA B-QMARK | 44.00 |
| 38 | audio/cbiz_tc_557.wav 10599a11-3bff-4ab0-836d-f9ed7a7cd8aa Proszę:196770-196920 pana:196980-197100 a:197130-197130 co:197280-197340 powinien… | O B-COMMA O O O O B-ELLIPSIS | O B-COMMA O O O O O | 50.00 |
| 39 | audio/cbiz_tc_26.wav 597f8543-06b5-4d46-b85c-cd8f43df2264 Numer:33990-34200 klienta:34320-34710 to:34800-34890 dwa:34980-35160 dwa:35220-354… | O O O B-COMMA B-ELLIPSIS | O O O B-COMMA B-FULLSTOP | 50.00 |
| 40 | audio/cbiz_tc_26.wav 597f8543-06b5-4d46-b85c-cd8f43df2264 No:166200-166230 dobrze:166290-166440 to:166530-166590 co:166680-166740 ja:166770-… | O B-COMMA O O O O O B-ELLIPSIS | O B-COMMA O O O O O B-QMARK | 50.00 |